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ABSTRACT 


In  this  paper  we  consider  the  three  node,  acyclic,  Jackson  queueing 
network  discussed  by  Simon  and  Foley  (1980).  We  provide  a  solution  to 
the  sojourn  time  problem  for  a  given  customer.  To  the  best  of  our 
knowledge,  this  is  the  first  solution  to  the  sojourn  time  problem  in 
any  acyclic  Jackson  network  with  overtaking. 
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1.  Introduction  and  Background.  A  customer's  sojourn  time  in  a  queueing 
network  is  the  total  amount  of  time  the  customer  spends  in  the  network. 
Equivalently,  it  is  the  sum  of  the  customer's  sojourn  times  at  each  of 
the  queues  it  visits  while  in  the  network.  The  equilibrium  or  steady 
state  sojourn  time  distribution  in  a  queueing  network  is  the  sojourn  time 
distribution  of  a  customer  who  sees  an  equilibrium  queue  length  distribu¬ 
tion  upon  his  arrival  to  the  network.  In  this  paper ,  we  analyze  the 
equilibrium  sojourn  time  distribution  in  a  three  node  Jackson  network. 

The  network,  which  we  will  refer  to  as  the  three  node  network, 
consists  of  three  single  server  queues  each  having  exponential  service 
times  with  parameter  y ^ ,  i=  1,2,3,  at  queue  i,  FIFO  queueing  discipline 
and  infinite  queueing  capacity.  There  is  an  exogenous  arrival  process  to 
queue  1  with  parameter  A.  Customers  departing  queue  1  go,  with  probability 
p,  to  queue  2,  and,  with  probability  1-p,  to  queue  3.  Customers  departing 
queue  2  go  to  queue  3  and  customers  departing  queue  3  leave  the  network. 
This  network  is  shown  in  Figure  1. 


Figure  1 


In  the  three  node  network  a  customer  C's  sojourn  time  is  either  the 
sum  of  C's  sojourn  times  in  queue  1,  queue  2,  and  queue  3  if  C  takes  the 
route  from  queue  1  to  queue  2  to  queue  3  or  the  sum  of  C's  sojourn  times 
*n  queue  1  and  queue  3  if  C  takes  the  route  from  queue  1  to  queue  3. 
Determining  the  equilibrium  sojourn  time  is  not  trivial  since  if  C  takes 
the  route  from  queue  1  to  queue  2  to  queue  3,  C's  sojourn  times  in  queue  1 
and  queue  3  are  dependent. 

That  the  sojourn  tiroes  of  a  customer  in  queue  1  and  queue  3  are 
dependent  given  the  customer  goes  to  queue  2  was  first  observed  by 
Mitrani  (1979).  He  observed  that  if  C's  sojourn  time  in  queue  1  was  long 
enough  to  guarantee  a  large  number  of  arrivals  to  queue  1,  then  while  C 
is  at  queue  2  many  of  those  customers  at  queue  1  could  depart  from  queue  1 
and  go  directly  to  queue  3.  Hence,  the  expected  number  of  customers  at 
queue  3  upon  C's  arrival  there  given  his  long  sojourn  time  at  queue  1  is 
larger  than  the  unconditioned  expected  queue  length  there.  Hence,  C's 
expected  sojourn  time  at  queue  3  given  his  long  sojourn  time  at  queue  1  is 
larger  than  C’s  unconditional  sojourn  time  at  queue  3.  Simon  and  Foley 
(1979)  formalized  this  argument. 

In  a  queueing  network  a  customer  a  is  said  to  overtake  a  customer  b  if 
there  exists  a  pair  of  queues  A  and  B  in  the  network  such  that  a  and  b  go 
from  A  to  B,  either  directly  or  indirectly,  such  that  a  departs  queue  A 
before  b  but  arrives  to  queue  B  after  b.  It  is  this  overtaking  which  causes 
the  dependence  of  C's  sojourn  times  in  queue  1  and  queue  3.  In  fact 
Lemoine  (1979)  showed  that  in  networks  without  overtaking  the  individual 
sojourn  time 8  are  independent.  Such  overtaking  occur,  of  course,  when  there 
are  alternate  paths  between  2  nodes. 
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Kiessler  (1980)  in  an  simulation  analysis  of  the  three  node  network 
showed  that  even  though  Cfs  sojourn  times  in  queue  1  and  queue  3  are 
dependent  the  correlation  coefficient  of  the  sojourn  times  between  these 
queues  was  insignificant  at  the  a  =  .05  level.  Further,  the  sojourn  time 
distribution  assuming  the  sojourn  times  in  queue  1  and  queue  3  to  be 
independent  was  not  significantly  different  from  the  actual  distribution. 

In  this  paper  we  will  derive  an  expression  for  the  equilibrium 
sojourn  time  distribution  in  the  three  node  network.  We  consider  the 
network's  queue  length  as  a  stationary  Markov  process,  i.e.,  a  Markov 
process  given  it's  equilibrium  distribution.  We  start  at  an  arbitrary 
arrival  time  to  queue  1  and  using  a  Palm  distribution  move  this  arrival 

to  the  origin.  Finding  the  total  sojourn  time  distribution  can  be 

reduced  to  finding  the  sojourn  time  in  queue  3  given  A,  where  A  is  the 
customer's  sojourn  times  in  queue  2  and  queue  1  and  that  the  customer 
takes  the  route  from  queue  1  to  queue  2  to  queue  3.  This  problem  is 
reduced  to  finding  the  queue  length  distribution  at  queue  3  when  the 
customer  arrives  there  given  A.  Then  we  look  at  the  queue  length 
distribution  at  queue  3  when  the  customer  arrives  there  given  A  and  the 

queue  length  at  queue  2  when  the  customer  arrives  to  queue  2.  Then  we 

find  the  joint  queue  1,  queue  3  distribution  when  the  customer  arrives  to 
queue  3  given  A  and  the  queue  length  at  queue  2  when  the  customer  arrives 
there.  Working  backwards  the  equilibrium  sojourn  time  can  be  computed. 

2.  Formal  Problem  Statement.  For  i“he  three  queue  network,  let 

Q^(t)  ■  be  the  queue  length  in  queue  i  at  time  t  for  i*  1,2,3; 
g(t)  -  (Q1(t),Q2(t),Q3(t)). 

From  the  comments  made  in  section  1,  (Q(t);  teS)  is  a  stationary  Markov 
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process  in  which  a  customer,  C,  arrives  to  the  network  at  time  0  and 


il  i?  h 

Pr{Q(0)  *  ±1  +  l,i2,i3} =  (l-p1)p1  X(1-P2)P2  /(1-P3)P3  J  (1) 

where  p1  =  X/p1,  p2«pX/u2,  and  p3  -  \/\iy  i^i^i-j  e  IN  *  {0,1,2,...}. 

Note  that  the  distribution  Pr  is  actually  the  Palm  probability  of  the 
stationary  Markov  process  <Q(t);  t  e  ]R}  embedded  at  arrival  times  to  the 
network. 

Let 

S  *  Cfs  sojourn  time  in  the  network; 

»  Cfs  sojourn  time  in  queue  i,  i  =  1,2,3; 

!r  if  C  takes  the  route  from  queue  1  to  queue  2,  to  queue  3 
r2  if  C  Cakes  the  route  from  queue  1  to  queue  3. 

Then  C's  sojourn  time  distribution  is  given  by 

Pr{S  <.  t}-pPr{S  <  t|R  -  r^  +  (1  -  p)Pr{S  <_  t|R  *  r2> 

=  p  Sq  Iq  yPr{S;j<^  t-u-y  |S2  *  u,S^  -  y,R=  r^> 

•  Pr{S2  e  (u,u+du)  IS^  =  y,R=  r^}  •  Pr{S1  e  (y,y+dy)  |R=  r^} 

+  (1-?)/^  Pr{S3  <t-y|S2  =  y,R-r2}  •  Pr{S2  e  (y,y+dy)  |R- r2}  (2) 

3.  Solution.  From  Simon  and  Foley  (1979) ,  we  have 

i, 

Pr{Q2(y) -i2  +  l|S1-y,R-r1>- (l-p2)p2  ,  i2  e  W,  (3) 

and 

i. 

Pr<Q3(y)  ■  i3  +  l|S1«y,R»  r2)  -  (l-p3)p3  ,  i3  e  IN.  (4) 

It  follows  from  (1),  (3),  and  (4)  that 
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-(w,-X)y 

Pr{Sx  e  (y,y+dy)  |R  =  r^}  ■  (u1  -  X)e  dy,  i-1,2,  (5) 

-(ji2-pA)u 

Pr{S2  e  (u.u+duJIS^-y.R*  r^}  *  (y2  -  pX)e  du,  (6) 

and 

~(Wo~X) (t-y) 

Pr{S3  <  t-y|si  =  y,R=r2}  =  l-e  .  (7) 

Hence,  the  only  term  not  known  in  (2)  is 

Pr{S3  1  t-ii-y  |s2  =  u,S3  *  y,R  =  r^).  (8) 

This  is  C's  sojourn  time  in  queue  3  given  C's  sojourn  times  in  queues  1 
and  2  and  that  C  takes  the  route  r^.  The  remainder  of  this  paper  deals 
with  the  calculation  of  this  quantity. 

4.  Calculation  of  P{S3  <_  t-u-y|S2  *  u.S^®  y,R=  r^}.  Note  that 
PrtS^  <_  t-u-y|S2  *  u,S^  =  y,R  *  r^} 

*  i=i  Pr^s3  —  t_u“ylQ3^u+y^  *  i*s2 =  u*sx  *y*R *  ^ 

•  Pr{Q3(u+y)  *  i|s2  -  u.Sj^  *y,R*  rj^}  (9) 

The  first  term  on  the  right  hand  side  of  (9)  is  C's  sojourn  time  at  queue 
3  given  the  queue  length  at  queue  3  when  C  arrives  there.  Hence, 

Pr{S3  1  t-u-y|Q3(u+y)  ■  i,S2  ■  u,S3  *y,R- r^}  »  F^Ct-u-y)  (10) 

where 

-y-(t-u-y) 

F(t-u-y)  -  1  -  e 

and  F*1  is  the  1th  fold  convolution  of  F  with  Itself. 

Now 


» 
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Pr{Q3(u+y)  *  i|S2  *  =y,R= 


queue  1  in  this  interval  we  need  to  know  Q^(v)  for  v  e  (y,y+u].  With  this 
in  mind  we  get 

Pr{Q3(u+y)  *i|Q2(y)  »m,S2  =  u,S1  =  y,R*r1} 


00  QO 


i^o  jlo  j2=o  Pr{Qi(u+y)  58  1i»Q3(u4y>  " 


Q2(y)  =  J1.Q3(y)  *  J2,Q2(y)  =  ®>s2 * u»si =  y»R  =  ri* 


•  Pr{Q1(y)  =  j1,Q3(y)  =  j2|Q2(y)  =  m,S2  *  u.Sj^  =  y,R=  r^. 

From  Simon  and  Foley  (1979),  the  second  factor  on  the  right  hand  side  of 
(12)  is 


(12) 


Jl 

_  -*y^  -  x-  J2 


i. 


V 


—  e  "J'(l-p3)p3  \ 


Define 


Now, 


=  time  from  y  until  the  ith  departure  from  queue  2  after  y  for 
!-!»•••,  m  • 


Pr{Q3(u+y)=i,Q1(uty)=i1|Q1(y)=j1,Q3(y)-j2,Q2(y)=ni,S2-u,S1“y,R-r1} 


/ 


f 


*l»kl  ^tn-l’^m-l  1  ®-l 

Pr(Q3(y+u).i,Q1(u«y)-l1,Zm-Zm_1  t  <  VVl>  I 


Q1<y>-J1.«3(rt-J2.Q2<y>-«,zlf.i-Vi-V2-*«-2 . V 
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Ptl,i(Vi)',i',)<Vi)'ki'VrV!‘  <VfV2'VfV!wVi,l 

<)l(V2)-l2><,3<V2)-k2--Ql<>',-Jl><>3<>')-32>V2-V2 . W 

Q2(y)=m,S2=u,S1=y,R=r1} 


•  Pr{Q1(z1)-£nHl,Q3(z1)=ki!i_1,Zie  (z1,21+d21)|Q1(y)-j1,Q3(y)»j2,Q2(y)*m 


S2=u,S^=y,R*r1>. 


(13) 


We  can  break  each  term  in  this  product  form  down  as  follows. 

For  h  =  1, . . . ,m-l, 

Pt(V  Vh>- Vh-V  Vh>-Vh- Vh-Vh-i e  <Vh-Vh-r  Vh-Vh-iwVh> 

ll)l<2i»-h-l,"tni-h-l'l!3<ziii-h-l)“kiii-h-l . <Vy)"jl’Q3(y,'J2' 

Vh-rVh-l’  *  *  •  ’Zi=zl’Ql(y)=Jl*Q3(y),sj2,Q2(y)=m’S2*u’Sl=y»R"ri} 

■  ,t(Qi<Vh»-Vh'«3<Vh)-VhiVh-Vh-i-vrW',,i(Vh-i)-Vh-i' 
¥Vh-i)-Vn-i . ,i(>>'ii'V>')’)2’Vb-i,Vh-i . V!i' 

Q2 (y ) *m»  S2=u,S^=y,R=r3) 

^r^m-h  Zm-h-l  e  ^Zm-h  Zm-h-l'Zm-h  Zm-h-l+<^Zm-h ^l^Zm-h-l^=*'m-h-l, 

Q3(Vh-l)=km-h-l . <^l^y)=^l*<^3^y)"^2,Zm-h-l*Zm-h-l*  *  *  ’  *Zl“zl’ 

Q2(y)-m,S2-u,S1-y,R-r1).  (14) 

The  following  two  lemmas  interpret  each  factor  on  the  right  hand  side 
of  equation  (14). 


8 


_2.  For  h  *  lf  .  ,m. 


Pr{  Ql(  “4m-h  ’  Q3  (  2m-h)  =km-h  I  Zm-h"Zm-h-l®Zm-h-zm-h- 1’ Q1 (  Vh-l^  “Vh-l  ’ 

Q3(Vh-l)*km-h-l . Ql(y)=jl’Q3(y)=j2,Zm-h-l*Vh-l,',,’Zl=zl’ 

(^(y^m.S^u.Sj-y.R-r^ 

*  Pr{Q-(z  u)*fc  u,Qa(z  ulz  .  -Z  u  I*2  ,-Z  1.  1>Q-|(2  ,)*£  U  1 

1  m-h  m-h  3  in— h  m-h  in— h  m-h-1  m-h  m-h-1  1 v  m-h-1  m-h-1 


Q3(Vh-l)“km-h-rQ2(y)=,n‘S2=u*Sl=y»R“r1}' 


(15) 


Proof .  Note  that 


(a)  Q,  (z  ,)=Q-(z  ,)  +■  the  number  of  arrivals  to  queue  1  in  (Z  ,,Z  .  ] 

i  m— n  i  m-n-i  m— h— 1  in— h 


-  the  number  of  departures  from  queue  1  in  (Z  .  lfZ  ,] 

m—  n— 1  m-n 


and 


(b)  Q3^Z|n-.h-l^*^3^Zm-h^  +  t^ie  num^er  °f  departures  from  queue  1  in 

who  go  to  queue  3  +  the  departure  from  queue  2  at 
^m-h  ~  t^ie  num^er  departures  from  queue  3  in 

^a-h-l’Vh1, 

Since  the  arrival  process  to  queue  1  is  Poisson  and  the  service  times  at  queue 

1  and  queue  3  are  exponential  only  Qi(zm_j1-1^  *^3^zm-h-l^  an<*  Zm-h”Zm-h-l  are 
needed  to  compute  the  probability  of  Q^(z  .  Hence,  the  result 

follows .  □ 

In  order  to  compute  the  right  hand  side  of  (IS)  we  need  to  know  the 
departure  process  from  queue  1  in  the  interval  (ztD_h-lZm-h^  * 
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Lemma  3. 


PHZ  -Zm  !  e  (z  -z  ,z  -z  .  +dz  )|Q,(z  -)=£,  .,0  (z  )=k 

m  m-1  m  m-1  m  m-1  m  1  ylv  m-1'  m-1  V3V  m-l;  m-l**’*’ 

Ql(y)ssjl»Q3(y)*j2»zm_i=2in_1.  ••  .,Zl“Zi,Q2(y)*m,s2=u,si=y,R=ri} 


■I 


1  if  z  =u 
m 

0  otherwise; 


(16) 


and  for  h  ■  1,  •  •  •  ,m-l 


Pr{zra-h'Vh-i e  (Vh‘Vh-i’Vh'Vh-i+dVh)  lQi(Vh-i)=Vh-i 

Q3(  Vh-l^  "km-h-l  *  •  *  * » Q1 (y)=J  1*  Q3(y)  2  ’  Vh-fVh-l’  *  *  * ’ Zl“zl * 

Q2(y)*m,  S^u.S^y.R*^} 


u-z 


m-h 


u-z 


’m-h 


u-z 


m-h-1 


xh-l 

/  on  0  <  z  .  1  <  z  n  +  (z  ,  z  . )  <  u. 

m-h-1  m-h-1  m-h-1  m-h-1 


(17) 


Proof.  The  proof  of  (16)  is  trivial  since  C  departs  queue  2  at  y+u  with 
probability  1  on  S2*ufS^“y.  The  remainder  of  the  proof  deals  with 
showing  (17). 

It  is  clear  that  for 


y<y  +  Vh-i<y  +  Vh<>,+“ 

given  S2-u,q2(,)-„,S1-y,g.t1.  end  2^ . Vh-1  ls 

independent  of  Qx(  Vh-1)  *Q3(zm-h-l) . Q1(y>tQ3(y).  Hence  (17)  equals 

Pr{Zm-h"Zm-h-l  6  (zro-h~Vh-l*Vh"Vh-l+dZm-h)l 
Zm-h-rZm-h-l’  •*  •’Zl“VS2*u‘Sl"y’R“rl’Q2<y)“,n} 
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I 


I 
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ft 


Pr(Z  ,-Z  ,  .  e  (z  ,-z  ,  ,,z  ,-z  ,  ,+dz  .)  tQo(y)=ni| 

m-h  m-h-1  ra-h  m-h- 1  m-h  m-h-1  m-h  2  1 


Z  v  1*2  .  ,  ,Z  =z,  ,S„*u,S,“y,R*r,  } 

m-n-i  m-n-i  l  l  i _ l _ 1 _ _ 

Pr{Q2(y)=m|Zm.h-1=Zm.h.1, • • . ,Z1=z1,S2*u,S1»yf R-rx} 


(18) 


Let  D(a,b)  be  the  number  of  departures  from  queue  2  in  the  interval  (a,b). 
Then  on  S^u^S^-y  ,R=r^, 


D(y,y+u)  =  Q2(y)  -  1 

since  C  sees  exactly  Q2(y)  -  1  customers  ahead  of  him  at  yt  the  time  at 
which  C  enters  queue  2,  and  since  the  queueing  discipline  is  FIFO.  These 
Q2(y)  -  1  customers  must  complete  service  at  queue  2  in  (y,y+u)  and  are 
the  only  customers  to  complete  service  at  queue  2  during  this  interval. 
Hence  (18)  becomes 


Pr{Z  -Z  u  .  e  (z  ,-z  ,  .,z  ,-z  ,  ,+dz  ,)tD(y+z  u  ,y+u)=h-l| 

m-h  m-h-1  m-h  m-h-1  m-h  m-h-1  m-h  7  m-h- 1"  * 


Vh-i’Vh-i . zr2rVUtSi~y»R~ri} 

Pr  D(y+Vh-l*y+uHiVh-l‘Vh-l . Z1-zliS2-u,S1-y,R-r1}  * 


(19) 


Since  on  S2*u,S^*y,R«r^  the  departure  process  from  queue  2  on  the  interval 
(y,y+u)  is  a  Poisson  process  (cf.  Simon  and  Foley  (1979))  we  get  that 
Zm-h~Zm-h-l,^y+Zm-h’^+u^  and  D(y+zm_^_^ ,y+u)  are  independent  of 

Zm_h_2 » •  •  • » zi  given  zm_h_i>S2”u»S]“y»R“ri  and  depend  on  1°  we 

need  Zm-h-l+(Zm-h”Zm-h-l)  "  u*  So  for  0<y+Vh-l<y+Vh-l  +  (WW) 
■  y+z^^  <  u  (19)  equals 
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Pr{Z  .-Z  ,  ,  e  (z  . -z  -,z  . -z  .  ,+dz  .  )  |s0“u,S,=yR=r1 } 

»u-h  m-h-1  '  m-h  m-h-1  m-h  m-h-1  m-h  1  2  1  J  1 

•  Pr  { I)  (  y+zra_h » y+u)  =h- 1 1  S2=u ,  S  J=y ,  H=  r  ^ } 

Pr  {  D(y+zm_h_1 » y+u)  *h  |  S2*u,  S^y ,  R=r1 } 


h-1 


pXe 


■pX(Vh‘Vh-l)  (pX(u’Vh))  -pX(u-zm-h) 


(h-1)! 


(pX(u‘Vh-i))  pX(u’Vh-i) 

—  e 


h! 


u-z 

*  -  ( - - - )  as  desired.  □ 

u-z  ,  i  u-z  .  n 
m-h-1  m-h-1 

5.  Conclusions.  Equation  (15)  still  must  be  calculated.  To  calculate 
(15)  we  need  the  time  dependent  departure  process  from  the  M/M/1  queue. 
Rosenshine  and  Pegden  (1981)  have  determined  this  for  the  special  case 
where  the  queue  starts  empty.  However,  we  need  the  distribution  of 
this  process  for  an  arbitrary  initial  queue  length.  Even  if  (15)  can 
be  calculated,  we  still  need  to  put  all  the  pieces  together.  That  is, 

(15)  into  ( 1 A) ,  (14)  into  (13),  (13)  into  (12),  (12)  into  (11),  (10) 
and  (11)  into  (9)  and  (5),  (6),  (7),  and  (9)  into  (2).  These  will  be 
subjects  of  later  papers. 
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